Smart scanning system

ABSTRACT

The present invention provides a smart scanning system comprising an integrated scanning and image capture system in which one or more image capture device(s) (e.g., still camera, video camera, etc.) and a barcode scanner are positioned within a common enclosure that is a component of a checkout station. The barcode of item is scanned and an image of the item is recorded. The identity of the item as determined based on the barcode is compared to its appearance as determined based on its image. If the identity is inconsistent with its appearance, a discrepancy is registered. It is then determined whether the discrepancy is due to fraud (e.g., theft) or device error. In the case of the latter, the system can be updated to prevent a repeat of the error.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation application of, and claims priorityto, U.S. application Ser. No. 11/756,391, filed on May 31, 2007, whichis hereby incorporated by reference in its entirety.

FIELD OF THE INVENTION

The present invention generally relates to a smart scanning system.Specifically, the present invention relates to an integrated system inwhich a barcode scanner and an image capture device (e.g., image capturedevice) are commonly contained/housed/positioned.

BACKGROUND OF THE INVENTION

Marketplace security has become a rising concern over recent years.Security and anti-theft concerns have only increased with thepervasiveness of scanners at checkout stations. It has becomeincreasingly frequent for perpetrators to switch and/or alter barcodesso that an item can be obtained for a cheaper price. In addition, manyretailers also utilize image capture devices to catch shop lifters.Unfortunately, current placement of image capture devices is eitherawkward, or of little use during the checkout process. Any currentplacement of image capture devices near checkout stations inevitablyplaces them in the way of customer's arms, heads or bodies, creatingopportunities for collisions, with damage to the person and/or the imagecapture devices. It also creates problems for the store, with regard tocleaning, theft, camera occlusions, etc.

In view of the foregoing, there exits a need for a solution that solvesat least one of the above-referenced deficiencies in the related art.

SUMMARY OF THE INVENTION

In general, the present invention provides a smart scanning systemcomprising an integrated scanning and image capture system in which oneor more image capture device(s) (e.g., still camera, video camera, etc.)and a barcode scanner are positioned within a common enclosure that is acomponent of a checkout station. The barcode of item is scanned and animage of the item is recorded. It is then determined whether theidentity of the item as determined based on the barcode is consistentwith its appearance as determined from the image. If not, a discrepancyis registered. It is then determined whether the discrepancy is due tofraud (e.g., theft) or device error. In the case of the latter, thesystem can be updated to prevent a repeat of the error.

A first aspect of the present invention provides a smart scanningmethod, comprising: receiving a scan of a barcode of an item via anintegrated scanning and image capture system; determining an identity ofthe item based on the barcode; capturing of an image of the item via theintegrated scanning and image capture system; and determining whetherthe identity is consistent with an appearance of the item as determinedfrom the image.

A second aspect of the present invention provides a smart scanningsystem, comprising: a module for receiving a scan of a barcode of anitem, the barcode being scanned via an integrated scanning and imagecapture system; a module for determining an identity of the item basedon the barcode; a module for receiving of an image of the item, theimage being captured via the integrated scanning and image capturesystem; a module for determining an appearance of the item based on theimage; and a module for determining whether the identity is consistentwith the appearance.

A third aspect of the present invention provides an integrated scanningand image capture system, comprising: a barcode scanner for scanning abarcode of an item; an image capture device for capturing an image ofthe item, the barcode scanner and the image capture device both beingpositioned within a common enclosure.

A fourth aspect of the present invention provides a program item storedon a computer readable medium for smart scanning, the computer readablemedium comprising program code for causing a computer system to: receivea scan of a barcode of an item via an integrated scanning and imagecapture system; determine an identity of the item based on the barcode;capture of an image of the item via the integrated scanning and imagecapture system; and determine whether the identity is consistent with anappearance of the item as determined from the image.

A fifth aspect of the present invention provides a method for deployinga smart scanning system, comprising: providing a computer infrastructurebeing operable to: receive a scan of a barcode of an item via anintegrated scanning and image capture system; determine an identity ofthe item based on the barcode; capture of an image of the item via theintegrated scanning and image capture system; and determine whether theidentity is consistent with an appearance of the item as determined fromthe image.

A sixth aspect of the present invention provides computer softwareembodied in a propagated signal for smart scanning, the computersoftware comprising instructions for causing a computer system to:receive a scan of a barcode of an item via an integrated scanning andimage capture system; determine an identity of the item based on thebarcode; capture of an image of the item via the integrated scanning andimage capture system; and determine whether the identity is consistentwith an appearance of the item as determined from the image.

A seventh aspect of the present invention provides a data processingsystem for smart scanning, comprising: a memory medium havinginstructions; a bus coupled to the memory medium; and a processorcoupled to the bus that when executing the instructions causes the dataprocessing system to: receive a scan of a barcode of an item via anintegrated scanning and image capture system; determine an identity ofthe item based on the barcode; capture of an image of the item via theintegrated scanning and image capture system; and determine whether theidentity is consistent with an appearance of the item as determined fromthe image.

An eighth aspect of the present invention provides computer-implementedbusiness method for smart scanning, comprising: receiving a scan of abarcode of an item via an integrated scanning and image capture system;determining an identity of the item based on the barcode; capturing ofan image of the item via the integrated scanning and image capturesystem; and determining whether the identity is consistent with anappearance of the item as determined from the image.

Any of these aspects can include one or more of the following additionalaspects: register a discrepancy if the identity is inconsistent with theappearance; determine whether the discrepancy is either an error orfraud; update the integrated scanning and image capture system toprevent the error from being repeated; provide a notification of thediscrepancy, the notification being at least one of a visualnotification and an audible notification.

BRIEF DESCRIPTION OF THE DRAWINGS

These and other features of this invention will be more readilyunderstood from the following detailed description of the variousaspects of the invention taken in conjunction with the accompanyingdrawings in which:

FIG. 1 depicts smart scanning system according to the present invention.

FIG. 2 depicts an item before being processed by the smart scanningsystem of FIG. 1 according to the present invention.

FIG. 3 depicts an item after being processed by the smart scanningsystem of FIG. 1 according to the present invention.

FIG. 4 depicts a more specific computerized implementation according tothe present invention.

The drawings are not necessarily to scale. The drawings are merelyschematic representations, not intended to portray specific parametersof the invention. The drawings are intended to depict only typicalembodiments of the invention, and therefore should not be considered aslimiting the scope of the invention. In the drawings, like numberingrepresents like elements.

DETAILED DESCRIPTION OF THE INVENTION

For convenience, the Detailed Description of the Invention has thefollowing Sections:

I. General Description

II. Computerized Implementation

I. General Description

As indicated above, the present invention provides a smart scanningsystem comprising an integrated scanning and image capture system inwhich one or more image capture device(s) (e.g., camera) and a barcodescanner are positioned within a common enclosure that is a component ofa checkout station. The barcode of item is scanned and an image of theitem is recorded. The identity of the item as determined based on thebarcode is compared to an appearance of the item as determined based onits image. If the two are inconsistent, a discrepancy is registered. Itis then determined whether the discrepancy is due to fraud (e.g., theft)or device error. In the case of the latter, the system can be updated toprevent a repeat of the error.

The integrated device of the present invention should not result in anincrease of volume of the enclosure of previous systems that houses onlybarcode scanners. The enclosure of the present invention protects theimage capture device(s) from collision, theft, dust and dir, water andsimilar fluids, etc. The image capture device(s) are generally locatedand oriented so that (1) they fit inside the small,already-somewhat-full space, (2) they are pointed in such a way thatthey can usefully see the desired field of view, and (3) they do notinterfere with the optical paths required by the pre-existing barcodescanner light source, mirrors, and reflected light intensity sensor. Inaddition, they do not require increasing the dimensions of glass used,so that no additional risk of glass breakage is incurred.

Referring now to FIG. 1, a smart scanning system 10 according to thepresent invention is shown. In general, smart scanning system 10comprises an integrated scanning and image capture system. Specifically,smart scanning system 10 includes at least one barcode scanner 12Aand/or 12B, at least one image capture device(s) 14 (e.g., a still imagecamera, a video camera, etc.), and barcode scanning and image processingsoftware. At least one barcode scanner 12A and one image capturemechanism 14 of smart scanning system 10 are positioned within a commonenclosure 19.

Image capture device(s) 14 is placed behind shield 17 (glass, plastic,etc.) as shown. Where multiple image capture devices 14 are used, one isplaced is placed so that one looks out along a path more or less normalto the vertical glass surface of the barcode scanner, and the otherlooks more or less straight up from below the horizontal surface of thescanner. The latter image capture device is also placed off to one side,so that it is actually under the (e.g., steel) rim surrounding theexisting shield 17 in that surface. As such, hole (e.g., 1″ in diameterin an illustrative embodiment) is cut in the steel rim, and covered witha separate, transparent plate. Regardless (as stated above), smartscanning system 10 also includes barcode scanning and image processingsoftware to perform the functions described herein. This software isstored on a memory medium that may or may not be positioned withinenclosure.

Referring now to FIGS. 2-3, the functions of smart scanning system 10will be explained. Specifically, a scan of a barcode 18 of an item 16(e.g., a consumer product) will be received the barcode scanner 12Aand/or 12B (shown in FIG. 1). Based on the barcode 18, the barcodescanning software will determine an identity of item 16 (e.g., a bottleof X brand cola). This occurs via known means such as cross-referencinga table of barcode values to product identities.

Before, after or simultaneous to the scan of the barcode), an image 20of item 16 will be captured by image capture device 14 (shown in FIG.1), and processed to determine an appearance of the item (which shouldbe consistent with the identity as determined based on the scan ofbarcode 18). The sequence of capturing and processing the image istypically as follows: wait for low motion of item 16; take dark andbright pictures; segment item 16 from background 20, the results ofwhich are shown in FIG. 4; extract at least one visual feature of item16 and determine the identity based on those visual features. Thisdetermination can be based on comparison of the image to an electronicdatabase or library of images associated with corresponding itemidentities. In addition, the appearance can be as general or as specificas desired. For example, the appearance can be specific so as toidentify the item (e.g., a bottle of X brand cola), or it can be moregeneral (e.g., a bottle of cola, or just cola based on the color).

Thereafter, smart scanning system 10 will compare the identity of item16 as determined based on the scan of barcode 18 to the appearance asdetermined based on the image to determine if the two are consistentwith one another. If not, smart scanning system 10 will register adiscrepancy and providing a notification of the discrepancy (at leastone of a visual notification and an audible notification). Where thereis a discrepancy, smart scanning system 10 will then determine todetermine whether the discrepancy is either error or fraud. For example,was the barcode tampered with or changed, or as the discrepancy due todevice error. Where device error caused the discrepancy, smart scanningsystem 10 can be updated (e.g., in response to an operator's input) toreflect the true identity of the item and its association with the imagejust captured.

II. Computerized Implementation

II. Computerized Implementation

Referring now to FIG. 4, a computerized implementation 100 of thepresent invention is shown. As depicted, implementation 100 includessmart scanning system 10 deployed within a computer infrastructure 102.This is intended to demonstrate, among other things, that the presentinvention could be implemented within a network environment (e.g., theInternet, a wide area network (WAN), a local area network (LAN), avirtual private network (VPN), etc.), or on a stand-alone computersystem. In the case of the former, communication throughout the networkcan occur via any combination of various types of communications links.For example, the communication links can comprise addressableconnections that may utilize any combination of wired and/or wirelesstransmission methods. Where communications occur via the Internet,connectivity could be provided by conventional TCP/IP sockets-basedprotocol, and an Internet service provider could be used to establishconnectivity to the Internet. Still yet, computer infrastructure 102 isintended to demonstrate that some or all of the components ofimplementation 100 could be deployed, managed, serviced, etc. by aservice provider who offers to implement, deploy, and/or perform thefunctions of the present invention for others.

As shown, smart scanning system 10 includes a processing unit 106, amemory 108, a bus 110, and device interfaces 112. Further, smartscanning system 10 is shown having barcode scanner 12 and image capturedevice 14 and storage system 116 that communicate with bus via deviceinterfaces (although barcode scanner 12 and/or image capture device 14alternatively could directly communicate with bus 110). In general,processing unit 106 executes computer program code, such as imageprocessing program 118 and barcode scanning program 122, which arestored in memory 108 and/or storage system 116. While executing computerprogram code, processing unit 106 can read and/or write data to/frommemory 108, storage system 116, and/or device interfaces 112. Bus 110provides a communication link between each of the components in smartscanning system 10. Although not shown, smart scanning system 10 couldalso include I/O interfaces that communicate with: one or more externaldevices such as a cash register, a keyboard, a pointing device, adisplay, etc.); one or more devices that enable a user to interact withsmart scanning system 10; and/or any devices (e.g., network card, modem,etc.) that enable smart scanning system 10 to communicate with one ormore other computing devices.

Computer infrastructure 102 is only illustrative of various types ofcomputer infrastructures for implementing the invention. For example, inone embodiment, computer infrastructure 102 comprises two or morecomputing devices (e.g., a server cluster) that communicate over anetwork to perform the various process of the invention. Moreover, smartscanning system 10 is only representative of various possible computersystems that can include numerous combinations of hardware. To thisextent, in other embodiments, smart scanning system 10 can comprise anyspecific purpose computing article of manufacture comprising hardwareand/or computer program code for performing specific functions, anycomputing article of manufacture that comprises a combination ofspecific purpose and general purpose hardware/software, or the like. Ineach case, the program code and hardware can be created using standardprogramming and engineering techniques, respectively. Moreover,processing unit 106 may comprise a single processing unit, or bedistributed across one or more processing units in one or morelocations, e.g., on a client and server. Similarly, memory 108 and/orstorage system 116 can comprise any combination of various types of datastorage and/or transmission media that reside at one or more physicallocations. Further, device interfaces 112 can comprise any module forexchanging information with one or more external device 114. Stillfurther, it is understood that one or more additional components (e.g.,system software, math co-processing unit, etc.) not shown in FIG. 4 canbe included in smart scanning system 10.

Storage system 116 can be any type of system capable of providingstorage for information under the present invention. To this extent,storage system 116 could include one or more storage devices, such as amagnetic disk drive or an optical disk drive. In another embodiment,storage system 116 includes data distributed across, for example, alocal area network (LAN), wide area network (WAN) or a storage areanetwork (SAN) (not shown). In addition, although not shown, additionalcomponents, such as cache memory, communication systems, systemsoftware, etc., may be incorporated into smart scanning system 10.

Shown in memory 108 of smart scanning system 10 is image processingprogram 118, which a set (at least one) of modules 120. The modulesgenerally provide the functions of the present invention as describedherein. Specifically (among other things), set of modules 120 isconfigured to: receive a scan of a barcode of item 16 via barcodescanner 12; determine an identity of the item based on the barcode;capture of an image of item 16 via image capture device 14; process theimage (e.g., segment item 16 from the background, extract visualfeature(s) of item 16); determine an appearance the item 16 based on theimage; and determining whether the identity is consistent with theappearance; register a discrepancy if the identity is inconsistent withthe appearance; determine whether the discrepancy is either an error orfraud; update the integrated scanning and image capture system toprevent the error from being repeated; provide a notification of thediscrepancy, the notification being at least one of a visualnotification and an audible notification.

While shown and described herein as a smart scanning system, method, andprogram item, it is understood that the invention further providesvarious alternative embodiments. For example, in one embodiment, theinvention provides a computer-readable/useable medium that includescomputer program code to enable a computer infrastructure to providesmart scanning. To this extent, the computer-readable/useable mediumincludes program code that implements each of the various process of theinvention. It is understood that the terms computer-readable medium orcomputer useable medium comprises one or more of any type of physicalembodiment of the program code. In particular, thecomputer-readable/useable medium can comprise program code embodied onone or more portable storage articles of manufacture (e.g., a compactdisc, a magnetic disk, a tape, etc.), on one or more data storageportions of a computing device, such as memory 108 (FIG. 4) and/orstorage system 116 (FIG. 4) (e.g., a fixed disk, a read-only memory, arandom access memory, a cache memory, etc.), and/or as a data signal(e.g., a propagated signal) traveling over a network (e.g., during awired/wireless electronic distribution of the program code).

In another embodiment, the invention provides a business method thatperforms the process of the invention on a subscription, advertising,and/or fee basis. That is, a service provider, such as a SolutionIntegrator, could offer to provide smart scanning. In this case, theservice provider can create, maintain, and support, etc., a computerinfrastructure, such as computer infrastructure 102 (FIG. 4) thatperforms the process of the invention for one or more customers. Inreturn, the service provider can receive payment from the customer(s)under a subscription and/or fee agreement and/or the service providercan receive payment from the sale of advertising content to one or morethird parties.

In still another embodiment, the invention provides acomputer-implemented method for smart scanning. In this case, a computerinfrastructure, such as computer infrastructure 102 (FIG. 4), can beprovided and one or more systems for performing the process of theinvention can be obtained (e.g., created, purchased, used, modified,etc.) and deployed to the computer infrastructure. To this extent, thedeployment of a system can comprise one or more of: (1) installingprogram code on a computing device, such as smart scanning system 10(FIG. 4), from a computer-readable medium; (2) adding one or morecomputing devices to the computer infrastructure; and (3) incorporatingand/or modifying one or more existing systems of the computerinfrastructure to enable the computer infrastructure to perform theprocess of the invention.

As used herein, it is understood that the terms “program code” and“computer program code” are synonymous and mean any expression, in anylanguage, code or notation, of a set of instructions intended to cause acomputing device having an information processing capability to performa particular function either directly or after either or both of thefollowing: (a) conversion to another language, code or notation; and/or(b) reproduction in a different material form. To this extent, programcode can be embodied as one or more of: an application/software program,component software/a library of functions, an operating system, a basicdevice system/driver for a particular computing and/or device device,and the like.

A data processing system suitable for storing and/or executing programcode can be provided hereunder and can include at least one processorcommunicatively coupled, directly or indirectly, to memory element(s)through a system bus. The memory elements can include, but are notlimited to, local memory employed during actual execution of the programcode, bulk storage, and cache memories that provide temporary storage ofat least some program code in order to reduce the number of times codemust be retrieved from bulk storage during execution. Input/output ordevice devices (including, but not limited to, keyboards, displays,pointing devices, etc.) can be coupled to the system either directly orthrough intervening device controllers.

Network adapters also may be coupled to the system to enable the dataprocessing system to become coupled to other data processing systems,remote printers, storage devices, and/or the like, through anycombination of intervening private or public networks. Illustrativenetwork adapters include, but are not limited to, modems, cable modemsand Ethernet cards.

The foregoing description of various aspects of the invention has beenpresented for purposes of illustration and description. It is notintended to be exhaustive or to limit the invention to the precise formdisclosed, and obviously, many modifications and variations arepossible. Such modifications and variations that may be apparent to aperson skilled in the art are intended to be included within the scopeof the invention as defined by the accompanying claims.

We claim:
 1. A smart scanning system, comprising: a scan module whichreceives a scan of a barcode of an item via a scanning and image capturesystem; a barcode module which determines an identity of the item basedon the barcode; a first capture module which captures a first image ofan appearance of the item via the scanning and image capture system,wherein the first image includes an image of the barcode; and adetermining module which determines whether the identity is consistentwith an appearance of the item as determined from the first image andthe second image.
 2. The smart scanning system of claim 1, furthercomprising: an extract module which extracts a feature of the item fromthe first image; and a compare module which compares the extractedfeature to an electronic database or library of images associated withcorresponding item identity.
 3. The smart scanning system of claim 1,further comprising: a second capture module which captures a secondimage of an appearance of the item via the scanning and image capturesystem.
 4. The smart scanning system of claim 3, further comprising: anextract module which extracts a feature of the item from at least one ofthe first image and the second image; and a compare module whichcompares the extracted feature to an electronic database or library ofimages associated with corresponding item identity.
 5. The smartscanning system of claim 3, wherein the second capture module capturesthe second image from a different direction of the first capture moduleand the first image.
 6. The smart scanning system of claim 5, furthercomprising: an extract module which extracts a feature of the item fromat least one of the first image and the second image; and a comparemodule which compares the extracted feature to an electronic database orlibrary of images associated with corresponding item identity.
 7. Asmart scanning method, comprising: receiving a scan of a barcode of anitem via a scanning and image capture system; determining an identity ofthe item based on the barcode; capturing a first image of an appearanceof the item via the scanning and image capture system, wherein the firstimage includes an image of the barcode; and determining whether theidentity is consistent with an appearance of the item as determined fromthe first image and the second image.
 8. The smart scanning method ofclaim 7, further comprising: extracting a feature of the item from thefirst image; and comparing the extracted feature to an electronicdatabase or library of images associated with corresponding itemidentity.
 9. The smart scanning method of claim 7, further comprising:capturing a second image of an appearance of the item via the scanningand image capture system.
 10. The smart scanning method of claim 9,further comprising: extracting a feature of the item from at least oneof the first image and the second image; and comparing the extractedfeature to an electronic database or library of images associated withcorresponding item identity.
 11. The smart scanning method of claim 9,wherein the second capture module captures the second image from adifferent direction of the first capture module and the first image. 12.The smart scanning method of claim 11, further comprising: extracting afeature of the item from at least one of the first image and the secondimage; and comparing the extracted feature to an electronic database orlibrary of images associated with corresponding item identity.
 13. Asmart scanning system, comprising: a scan module which receives a scanof a barcode of an item via a scanning and image capture system; abarcode module which determines an identity of the item based on thebarcode; a first capture module which captures a first image of anappearance of the item via the scanning and image capture system; asecond capture module which captures a second image of an appearance ofthe item via the scanning and image capture system, wherein the secondcapture module captures the second image from a different direction ofthe first capture module and the first image; and a determining modulewhich determines whether the identity is consistent with an appearanceof the item as determined from the first image and the second image. 14.The smart scanning system of claim 13, further comprising: an extractmodule which extracts a feature of the item from at least one of thefirst image and the second image; and a compare module which comparesthe extracted feature to an electronic database or library of imagesassociated with corresponding item identity.